Automated Hierarchical POMDP Construction through Data-mining Techniques
نویسندگان
چکیده
Markov models provide a useful representation of system behavioral actions and state observations, but they do not scale well. Utilizing a hierarchy and abstraction as in HHMMs improves scalability, but they are usually constructed manually using knowledge engineering techniques. In this paper, we introduce a new method of automatically constructing HHMMs and subsequent hierarchical POMDPs using the output of a sequential data-mining algorithm. We present the theory of this technique and frame it in a case study involving a learn-
منابع مشابه
Automated HPOMDP Construction through Data-mining Techniques in the Intelligent Environment Domain
Markov models provide a useful representation of system behavioral actions and state observations, but they do not scale well. Utilizing a hierarchy and abstraction as in hierarchical hidden Markov models (HHMMs) improves scalability, but they are usually constructed manually using knowledge engineering techniques. In this paper, we introduce a new method of automatically constructing HHMMs usi...
متن کاملAutomated detection of coronavirus disease (COVID-19) by using data-mining techniques: a brief report
Background: The clinical field has vast sick data that has not been analyzed. Discovering a way to analyze this raw data and turn it into an information treasure can save many lives. Using data mining methods is an efficient way to analyze this large amount of raw data. It can predict the future with accurate knowledge of the past, providing new insights into disease diagnosis and prevention. S...
متن کاملHierarchical Alpha-cut Fuzzy C-means, Fuzzy ARTMAP and Cox Regression Model for Customer Churn Prediction
As customers are the main asset of any organization, customer churn management is becoming a major task for organizations to retain their valuable customers. In the previous studies, the applicability and efficiency of hierarchical data mining techniques for churn prediction by combining two or more techniques have been proved to provide better performances than many single techniques over a nu...
متن کاملA Reinforcement Learning System Based on State Space Construction Using Fuzzy ART A Reinforcement Learning System Based on State Space Construction Using Fuzzy ART
A new reinforcement learning system using fuzzy ART (adaptive resonance theory) is proposed. In the proposed method, fuzzy ART is used to classify observed information and to construct effective state space. Then, profit sharing is employed as a reinforcement learning method. Furthermore, the proposed system is extended to the hierarchical structures for solving partially observable Markov deci...
متن کاملVisual divisive hierarchical clustering using k-means
This paper presents a browser-based semi-automatic taxonomy construction tool Vd-chuck which is able to incorporate text and data mining algorithms into a userfriendly interface. The presented system is browserbased. Its unsupervised learning for concept suggestion and different visualization techniques assist the user with textual and numerical data analysis. We tested the Vdchuck system on a ...
متن کامل